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CONFERENCE FACILITY \ 


This invention relates to teleconferencing, and in particular a facility for 
the generation of images relating to a "virtual meeting space", within the context 
of which individuals at a plurality of locations remote from each other may interact 
in a manner which emulates a conventional meeting. 


' rx A number of systems are being developed which define a virtual Cartesian 
space in which the individual members of a teleconference are positioned, and 
each individual's view of the meeting space as shown on their display is 
determined by the individual user's position within the Cartesian space. Examples 
are to be found in United States Patent 5,491,743 granted to Shiio et al (assigned 
to IBM), and European Patent Application no 0 516 371, in the name of Fujitsu. 
Facilities may be provided in such systems to allow documents to be created, 
retrieved, etc. For example, one wall of the "meeting space" may be represented 
as a drawing board on which images can be represented. The user wishing to use 
the drawing board carries out a control function which causes the system to 
change the relative positions of the user and the whiteboard in the virtual space 
such that the user can generate images on it. 

Individual users are represented in the virtual space display by computer- 
generated representations of the users, known as "avatars" (or "icons"). These 
may be derived from video images of the users, either live or retrieved from a 
store, but usually they are digitally generated representations. In general, each 
user is able to select the appearance of his or her avatar in the virtual space from a 
menu of characteristics. Alternatively, each individual user may be able to select, 
for his own viewpoint, how each of the other users' avatars will appear. Other 
characteristics of the meeting space, such as the colour and shape of the elements 
of the meeting space, may also be selectable by the user. 

There are a number of disadvantages to the conventional virtual meeting 
spaces. In the system discussed in the Shiio patent already mentioned, an 
overview of a conference room is represented. Each user sees the same view, 
including his or her own avatar in whatever position it has been placed. In this 
arrangement the user does not have the feeling of being in a room with the other 
participants, but is merely watching his or her avatar's activities, from a vantage 
point outside the room. It is possible to arrange for each user to see only the 
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avatars of the other users, and not his own, from a viewpoint such that the relative 
positions of each avatar to each other avatar and to the user's viewpoint is consistent 
between users. For example, with reference to Figure 2 of the drawings attached to 
this specification, if a user "3" is shown a representation of the meeting space in 
5 which the avatar of user "1" is facing him, with avatars of users "2" and "4" facing 
each other at 90° to the viewpoint of user "3", then the user "4" would see the avatar 
of user "2" facing him, and the avatars of users "1 " and "3" facing each other at 90° 
to his viewpoint. This gives a more realistic representation of a real conference room, 
but the relative positions of the users make it difficult to view all the users and other 
10 elements of the conference facility at the same time on a conventional video monitor. 

In the Fujitsu reference mentioned previously, the avatars of the other users 
are arranged around the user's virtual viewpoint, as if on a turntable, which can be 
^ rotated to bring a selected avatar into view. The user represented by that avatar will 

■Jj not necessarily be looking at the first user's avatar. Thus eye contact is not 

:U 1 5 necessarily two-way, and participants will not interact as they would in a real space as 

if! two avatars which appear adjacent to one user will not necessarily appear so to 

^ another user. 

JHfl Furthermore, events taking place in the meeting space, such as an individual 

operating the "whiteboard", or joining or leaving the meeting, require complex 

Jn 20 navigation around the virtual space in order to be reasonably realistic. In both 

systems, such navigation requires considerable thought on the part of the user, to 

: u3 ensure that unrealistic occurrences, such as one user walking through another, or 

through the furniture, do not take place. Such distractions can disrupt the conduct of 
the conference itself. Furthermore, if a drawing facility is provided, it can only occupy 
25 a portion of the view, making it difficult to use. 

ifi 4 ^^ According to the invention, there is provided a method of representing users 
on a display device in a telecommunications conferencing facility by means of 
graphical representations corresponding to the respective users, wherein the users are 
depicted as carrying out symbolic actions, relating to the various events taking place 
30 during the virtual telecommunications conferencing process, each user being presented 
with a viewpoint representative of the position of that user in a virtual space and in 
which the other users and their activities are represented by means of graphical 
representations, and characterised in that in the viewpoint presented to each user the 
representations of each of the other users are in positions, and have movements, 
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relative to each other and the viewpoint, selected according to the viewpoint of the 
user. 

According to a second aspect, there is provided a telecommunications 
conferencing system comprising display control means for representing users on 
5 display devices by means of graphical representations corresponding to the respective 
users, the display control means being arranged to depict symbolic actions carried out 
by users, relating to the various events taking place during the virtual 
telecommunications conferencing process, each user being presented with a viewpoint 
representative of the position of that user in a virtual space and for presenting, to each 

10 user a representation of the other users and their activities; 

characterised in that the display control means is arranged to represent the presence 
and activities of each user to each other user by means of symbolic positions and 
movements, presented to each user such that in the viewpoint presented to each user 
the representations of each of the other users are in relative positions, and have 

1 5 relative movements, selected according to the viewpoint of the user. 

This invention allows the realistic representation of a meeting by providing a 
"meeting space" which is consistent from the viewpoint of each user, without 
necessarily being consistent between users. 

The more inconvenient aspects of a real meeting space can be eliminated, 

20 rather than emulated. For example, the accessing of a facility by one user for viewing 
by other users can be represented in a different manner for the viewing users and the 
accessing user, and users not currently actively engaged in the telecommunications 
conference can be represented in a different manner from those currently viewing the 
conference. 

25 Activities such as providing copies of documents may be represented 

symbolically, and social cues may also be represented, in response to specific 
commands from the individual users. 

Each user's representation of the meeting space may be arranged such that 
all other elements of the meeting space, including the other users, appear within a 

30 narrow and preferably fixed field of view, corresponding to his own display device's 
dimensions. For example, a user with a wide-screen panoramic display device may 
depict the other users spaced further apart than would a user with a much smaller 
screen, for example on a lap-top computer. 

This improves the ease of use of the system by each user in the meeting 

35 space, as changes of viewpoint are not necessary. It allows all users to see each 


other without changing viewpoint, which is not possible even in a real meeting 
space. 

The operation of the invention can take place by interaction between a 
central "server", and a plurality of client devices. The central server controls those 
aspects of the system common to all users, such as information relating to the 
activities to be depicted, and the client devices are responsible for those aspects 
specific to each user, such as actions taken by the respective user, information on 
which is transmitted to the server for depiction on the other user terminals. 

The invention will now be discussed in greater detail with reference to the 
drawings. 

Figure 1 represents the general configuration of a system arranged to 
operate the present invention, 

Figure 2 is a representation of a virtual meeting space according to the 

prior art, 

Figure 3 and 4 are a representations of a virtual meeting space according 
to the invention, 

Figures 5 to 12 are various representations of the virtual meeting space as 
seen by different individual users in different circumstances as will be described. 


In Figure 1 there is shown an arrangement to allow four users 1, 2, 3, 4 to 
interact in a virtual teleconference. Each user has a respective human/machine 
interface unit 21, 22, 23, 24, which includes all the necessary video and audio 
equipment for the user to see and hear what is happening in the virtual meeting 
space, and the necessary user input devices (e.g. keyboards, computer "mouse" 
etc.) to provide input to the virtual meeting space. Each interface, 21, 22, 23, 24 
is connected to a respective client apparatus 11, 12, 13, 14 which provides an 
interface between the user and a main server 10 which controls the operation of 
the meeting space. The server 10 has, as a further input, a store 30 which 
maintains permanent data defining the virtual meeting space. The control of the 
meeting space is carried out by interaction between the client apparatuses 11, 12, 
13, 14 and the server 10. In some embodiments most of the display control 
functions may take place in the server 10, but in systems where the display 
apparatuses 21, 22, 23, 24 are dissimilar, more of the display control functions 
may be different for each apparatus, therefore requiring more of the display control 
functions to be distributed in the client apparatus 11, 12, 13, 14. 



In response to inputs from one of the users (e.g. user 1) through his 
respective user interface (21) the client apparatus transmits these inputs to the 
main server 10 which, in accordance with the meeting space definition 30, 
controls the images to be represented on the other users screen 22, 23, 24 to 
5 represent the activities of the user 1, input through interface device 21 . As a very 
simple example, the actions of the user 1 when first establishing contact with the 
meeting space are translated by the client computer 1 1 and converted by the 
server 10, into a representation of the user 1 entering the meeting space, which is 
in turn passed to the individual clients 12, 13, 14 to be represented as the avatar 
0 of the user 1 moving into the field of view of the display devices 22, 23, 24. 

The manner of representation of the individual user 1 in the virtual space 
may be selected either by the user 1 through his respective client device 1 1, or by 
each receiving user 2, 3, 4 in the meeting space, who may each select an avatar 
according to his own requirements to represent the user 1. Similarly, some parts 
5 of the virtual meeting space may be defined centrally in the meeting space 
definition unit 30, whereas other aspects may be defined by each individual client 
11, 12, 13, 14 independently of the others. Such definitions may include colour 
schemes, the relative locations of the individual users 1,2,3, 4, etc. 

In Figure 2 is shown a representation of a prior art virtual meeting space. 
0 It will be noted that the virtual meeting space shows four users 1,2,3, 4, located 
at equally spaced intervals around a table 31. It will be noted that in order for any 
user (e.g. user 3) to clearly see all the other users (1, 2, 3, 4), a fairly wide angle 
of view is required. In order to view different users the direction of view must be 
changed, and it is difficult to view all members of the virtual conference 
5 simultaneously. This problem obviously increases, the more people are taking part 
in the- conference. Furthermore, if there are items such as a representation of a 
"whiteboard" in the meeting space, it cannot be visible to all participants at once, 
as if it is facing user "1", for example, the avatar of user "3" will be facing away 
from it. It will therefore not appear in his field of view. 
) Figure 3 shows a virtual meeting space in the system according to the 

invention as seen by a user 3. It will be noted that for the user 3 the three 
remaining users 1, 2, 4 now subtend a much narrower angle. 

Figure 4 shows the same virtual meeting space, but seen from the 
viewpoint of a different user 4. It will be seen that the other users 1, 2, 3 also 
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subtend a narrow angle as seen from the user 4, in the same way that in Figure 3 
the users 1, 2, 4 subtend a narrow angle as seen from the user 3. The server 10 
and clients 11, 12, 13, 14 are arranged to represent the relative positions of the 
avatars according to this distorted co-ordinate system, such that for each user the 
5 other users subtend a relatively narrow angle and may all appear within the same 
field of view. It will be noted that although the angular distance between the 
users is different from each viewpoint, the order in which they appear around the 
table is preserved. This allows sociological cues, such as interactions between 
neighbours around a table, to occur consistently regardless of the viewpoint. 

1 0 Figures 5 to 1 2 show various representations of the virtual meeting space, 

as viewed by different individual users 1, 2, 3, 4, in different circumstances. The 
avatars representing each user are indicated by reference numerals 1, 2, 3 and 4. 
For clarity in this description, the avatars for each user has a respective shape, 
which is consistent between viewpoints, but as has been discussed, each user 

15 may choose to represent a particular participant in a different way in his own 
viewpoint. The viewpoint represented in each figure is indicated by the reference 
numeral relating to the user terminal on which the view is being represented. 
Therefore, Figures 5, 7, 8 and 9 show the view as seen on user terminal 21, 
belonging to user 1; Figure 6 and 12 show the view on terminal 24, belonging to 

20 user 4, and Figures 10 and 11 represent terminals 22 and 23 respectively, in use 
by users 2 and 3 respectively. Common to all the virtual meeting space images 
are the avatars of the other users 1, 2, 3, 4, a table 31 and a "whiteboard" 32. 
Other elements will be described with reference to the figures in which they are 
represented. It should be noted that for each user, all other users and elements 

25 of the meeting space are in full view, without any need to change viewpoint. This 
is so, despite some elements appearing, to one user, to be behind another user. 

Figure 5 shows schematically the view of the virtual meeting space as 
seen by one of the participants 1 . Users 2 and 4 are also taking part in the 
teleconference; this can be seen by the full representation of the avatars 2 and 4 

30 in their respective positions around the table 31. User 3, although allocated a 
position in the virtual meeting space has not yet entered the meeting space, and 
his avatar is replaced by a representation of an empty seat 3. Users 2, 3, and 4 are 
represented as subtending an angle of approximately 90°, with the avatars of 


am 


users 2 and 4 each at approximately 135° from the angular position around the 
table 31 of the viewing user 1 . 

Figure 6 shows the same situation as viewed by another user 4. It will be 
seen that the view is the same as that in Figure 5, except that user 1 is 
5 represented instead of the user 4. Note that the relative positions around the table 
are preserved i.e. user 3 is still to the left of user 2, but the angular distance 
between users is not the same as in Figure 5. In the meeting space as viewed by 
the user 4, users 1 and 2 are separated by only approximately 45°, with the users 
1 and 3 at approximately 135° angular position from the viewing user 4. 
0 Figure 7 represents the view of the meeting space as viewed by the user 

1, in the situation where two of the users 2, 3 are conducting a conversation 
between themselves, using a separate connection. The avatars of the users 2 and 
3 are shown as facing each other and closer together than in other views, 
indicating that they are not currently primarily concentrating on the meeting space. 
5 The facility for private discussion (conferring) may be provided in virtual meeting 
spaces in order to allow discussion between two parties, for example to agree a 
negotiating position before presenting it to the meeting at large. 

A user may indicate that he wishes to close the conference in the near 
future, or to withdraw from it, by entering a command to the server. The server 
0 responds by causing the avatar of that user to perform an action representative of 
activities performed by real people in such a situation. 

Such actions may include putting papers into a case, looking at a clock (if one is 
present in the virtual meeting space) or at a wristwatch, as shown in Figure 7 (user 
4), or putting a coat on. Different actions may be represented each time the user 

5 activates the command, to indicate increasing proximity to the closure time. The 
user may pre-programme such cues to appear at predetermined times leading up to 
the desired closure time. 

Figure 8 is a representation in which the user 2, although still connected 
to the meeting space, is consulting a document. This can be done by the user 2 

) by calling up the relevant document on his computer screen (for example by 
'clicking' with a 'mouse'), the meeting space typically being relegated to a small 
representation of the meeting space in one corner of the viewpoint of the screen. 
The system shows the avatar of the user looking at a representation 33 of a 
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perceives the whiteboard as being behind himself: each user perceives the 
whiteboard as behind someone else. Thus each user will find the whiteboard is 
within his field of view. 

Movements, positions, and other attributes of the individual users are thus 
5 represented symbolically in the virtual meeting spaces. Each user will see the 
other users' avatars behaving in an appropriate way for activities taking place 
during the meeting, although the users will have a different view as to the detail of 
such activities, e.g. the distance that another user has to move in order to access 
an element, the relative distances between avatars, and even the appearances of 
10 the individual avatars and the fixed parts of the meeting space. 
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